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DUAL COLOR CAMERA MICROSCOPE AND 
METHODOLOGY FOR CELL STAINING AND 
ANALYSIS 

5 

RELATED APPLICATIONS 

This is a continuation of application Ser. No. 315,443, 
filed Feb. 24, 1989 and now U.S. Pat. No. 4,998,284, 
which is a continuation-in-part of co-pending U.S. pa- 
tent application Ser. No. 121,674, filed on Nov. 17, 10 
1987, in the names of James W. Bacus and Robert J. 
Marder, which was entitled "Methods and Apparatus 
for Immunoploidy Analysis" and now U.S. Pat. No. 
5,016,283; which in turn is a continuation-in-part of 
application, U.S. Ser. No. 927,285, Wed Nov. 4, 1986 in 15 
the name of James W. Bacus, and entitled "Analysis 
Method and Apparatus for Biological Specimens 1 ' and 
now U.S. Pat. No. 5,018,209; which is a continuation-in- 
part of application, U.S. Ser. No. 794,937 filed Nov. 4, 
1985, in the name of James W. Bacus and entitled 20 
"Method of And An Apparatus for Image Analyses of 
Biological Specimens" and now U.S. Pat. No. 
4,741,043; all of which are commonly assigned with the 
present application. These previous disclosures are 
hereby expressly incorporated by reference herein. 25 

FIELD OF THE INVENTION 

The present invention generally relates to an appara- 
tus for the measurement of cell object features, such as 
morphology and mass, and a methodology to enhance 30 
cell structures for quantitative measurement methods 
utilizing this apparatus. The present apparatus finds 
particular application in studies on cell structures in the 
field of pathology, which may include human tissue for 
cancer research or diagnosis. 35 

In the pathology laboratory, visual observation is the 
present method for examining cells and tissue. The 
shape and texture of suspected cancer cells are ob- 
served, after staining to contrast and enhance the cells, 
by a pathologist, primarily through a microscope, who 40 
then classifies these cells into a normal category, or one 
of several abnormal or possibly cancerous categories. 
Such evaluations are very subjective and do not always 
differentiate or precisely quantify small changes in 
DNA, proteins or other substances within individual 45 
cells or in very small populations of abnormal cells. For 
example, these small changes may represent an incipient 
stage of cancer or a change in cell structure due to 
treatment of such cancer by chemotherapy or radiation. 
Therefore, small changes are important in the diagnosis 50 
and prognosis of any such diseases. 

The pathologist, viewing a stained specimen under a 
microscope, possesses the discerning expertise of a per- 
son skilled in classifying cells as normal or abnormal, 
who can thus proffer a diagnosis and/or prognosis. The 55 
experienced pathologist is able to make relatively quick, 
infinite gradations of classifications as "almost normal'*, 
"slightly abnormal", etc. On the other hand, the classifi- 
cation and measurement of cell features and parameters 
manually by a pathologist on a cell-by-cell basis is ex- 60 
tremely tedious and time-consuming. Statistical analysis 
of cell data taken by hand is relatively difficult, as each 
record has to be individually entered and processed. 
For different records or analyses, which are taken at 
different times, as well as under varying conditions, 65 
broad statistical categorizations may be unreliable. 

Alternatively, automatic cell analysis provides the 
pathologist with specialized equipment to perform an 



analysis. In automatic cell analysis, for example, a flow 
cytometer, mass tests are performed in gross on a speci- 
men cell population without exclusion or inclusion of 
distinguishing population data thereof. The specimen is 
measured "as is" without knowledge of what cells or 
how many cells are being measured. Important single- 
cell data or data from relatively small groups of cells is 
lost in the overall averaging of such a specimen. Fur- 
ther, such automatic tests frequently require relatively 
large specimen samples, and the sample is frequently 
destroyed or consumed. 

There are commercially available, general purpose, 
flow cytometers. However, they are extremely expen- 
sive and can handle only liquid blood specimens or 
tissue desegregation. These cytometers are incapable of 
working on standard tissue sections or using conven- 
tional microscope slides, which are the preferred speci- 
men formats of pathology laboratories. Additionally, a 
flow cytometer precludes the analysis of cell morphol- 
ogy, such as texture, size and shape of cell nuclei. 

Optical enhancement of cell cytoplasm for different 
types of cells is, in some cases, incompatible with cur- 
rent DNA staining technique. That is, the optical en- 
hancement factor or stain technique for the cytoplasm 
should be compatible with the imaging technique for 
computer analysis of optical density while simulta- 
neously not impairing the sensitivity of the imaging 
techniques for the nuclear staining. In the example of 
Feulgen staining, the optical enhancement of cytoplasm 
after Feulgen staining of the DNA is not practicable as 
the Feulgen process uses highly acidic reagents, which 
may destroy other optical enhancement factors or 
stains. A further limiting factor or requirement is that 
any staining done prior to a Feulgen or DNA-marking 
stain cannot disrupt or negatively affect the nuclear 
material, which might detrimentally affect the subse- 
quent nuclear marking stain. 

Therefore, one of the main thrusts of continuing re- 
search is the development of stains and staining tech- 
niques, which will provide distinguishable optical en- 
hancement or marking of the separate components of 
cells, for example, the cytoplasm and nuclear DNA, 
without interfering with the image analysis of the other 
components. As a practical matter, however, the distin- 
guished components of the cells without the means to 
analyze these separate characteristics, is of minimal 
value, although it certainly would be an asset. There- 
fore, it is necessary to provide the chemical composi- 
tions and components to distinguish the characteristics 
of the various cell components, and to provide the me- 
chanical equipment and electronic networks to analyze 
the distinguished cell components. Earlier disclosed 
structures were adequate for transferring and communi- 
cating the image to the processing network, however, it 
is desirable to minimize the physical structure, or at 
least the apparatus size, for improved -manufacture and 
esthetic appearance, as well as improving the means for 
calibration and utilization of the available light energy 
of the image. 

In the above-identified patent application Ser. No. 
121,674, there is disclosed a system, that performs a 
two-color assay such as an immunoperoxidase staining 
of nuclear antigens, using a pair of optical filters which 
are manually shifted to perform a serial analysis of each 
one of the two stained materials. 

The present invention is directed to the elimination of 
the need to change, filters, which is a relatively slow 
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system and is subject to operator error. For example, cell component in the nucleus and a red chromogen 
should the operator forget to shift from the first filter to with alkali phosphatase combines with a cell compo- 
the next filter, or if he does not operate the filters in the nent in the cytoplasm. Also, in oncogene products it is 
proper sequence, the resulting measurements would be possible to measure estrogen or progesterone receptors 
in error. The time needed for manual shifts of filters 5 for nuclear analysis and antibodies to measure materials 
slows down the process relative to a two-color, simulta- in the cytoplasm. Other combinations of stain materials 
neous analysis. More specifically, the processing and to mark the components of the cell, that is nucleus or 
analysis rate are enhanced when two colors are simulta- cytoplasm, may be used. In each instance, there is a 
neously rather than sequentially analyzed, as is the tech- nee d to separate the emission or transmission speclrums 
nique with the two-color, manual filtering system. As a 10 f or the respective stains and, as will be explained, to 
result of using a dual-color simultaneous analytic tech- match the filters for them, 
nique, the results of the analysis are more quickly avail- 
able to the viewer and the software programs are easier SUMMARY OF THE INVENTION 

to usc * The present invention provides methods and appara- 

Programs currently available for use with the dual 15 tus for Ihe measurement of selected features and param- 

color analysis include cell population identification and eters of ^ m a ccll population by the optical identifi- 

DNA measurement of cell nuclei, called a ploidy analy- calion of their t M well „ lheir morphology . e^Im 

sis. Another program evaluates nuclear antigens stained apparatus measured the DNA content of selected cells 

by immunoperoxidase methods, such as estrogen or of a subpopulation selected from a cell specimen, which 

progesterone receptor assays, to prov.de a quantttadve 20 subpopu i ation was ^ on the o X Q marking of 

nuclear antigen measurement. A third program pro- certain ce lls therein 

vides a quantitative proliferation inde, for measuring The aratus and techni further cn . 

proliferation ,n either cells or tissues by us.ng nn- hance ^ . ^ ^ methods ^ t M 

munoperoxtdase staining techniques with an antibody . - u j i * u 

to proliferated cells. This proliferation index is fully 25 they P T ^ TT & ™* * na * UC teC , h * 

described in a co-pending application filed of even date m ^ ue * for * ffer « nt cvt <>P !asms «? ce » VW*» 

entitled "Method of and Apparatus for Measuring Pro- " ons; 2 > * nhance * ° T c ° lor "Potion for greater 

liferation" by James Bacus et al. The dual color system d"tinguishment by the image processing equipment; 3) 

of this invention is also used to perform the cell mea- a . com P act ' efricie "f and ^-adjusted image aoqiw- 

surement described in the above-referenced patent ap- 30 Uo " a PP aratus to further enhance the image equality 

plications. and accuracv of the image processing techniques; and, 

The present invention provides an inexpensive and 4 > a " a PP ara ^ fox parallel image processing as opposed 

easily adjustable dual-color sensor system, which aligns to the P^sently available serial image processors. These 
and focuses chemically-optically enhanced images of characteristics thus provide an improved calibration 

cells and/or materials thereon for viewing by a person; 35 and ima S e Pressing technique for the analysis of cells 
and, for making precise quantitative measurements of or otner materials, either biological or inorganic, by 

the stained materials associated with the cells. Chromo- ima S e analysis techniques; improve both the method 

gens used in staining arc wide band spectra emitters and apparatus for quantitative ploidy analysis of cells 

rather than narrow band spectra emitters, and conse- through improved image pattern recognition equip- 

quently interference between their respective spectrums 40 ment i and provide an enhanced equipment package, 

is a problem to be overcome. Glare is also present, which is both visually more appealing and less obtru- 

which tends to add light that interferes with precise sive » as wcI1 35 providing a more technically accurate 

optical density measurements, and this problem must and efficient utilization of available light energy, 

also be overcome. Good spectral contrast in a stained ^ n addition, the improved apparatus has narrow 

cell enhances the ability to quantify small changes in 45 bandpass filtering to reduce glare as well as specific 

DNA proteins or other substances, and this makes it narrow bandpass filters to distinguish the spectra for the 

possible to provide the required precision quantitative monochromatic camera and not the standard RGB, 

measurements. Also, signal measurements contain sig- sond state television sensors frequently utilized in these 

nificant electrical noise, which must be removed during apparatus. The structure eliminates the need to mechan- 

electronic processing. This noise deletion is especially 50 ically move either the filters or sample position for 

required where the signal intensity is not maximized by review of different cell components and it is readily 

taking optical density measurements at a measured adaptable to or operable with cell-component stains and 

wavelength. Hence, it is desirable make narrow band staining techniques. 

wavelength measurements for the respective optical These and other features and objects of the invention 

densities at each of two specifically different narrow 55 will become more readily apparent from the following 

band wavelengths that do not overlap or interfere with description of the drawings and the preferred embodi- 

cach other. mcnt 

The present invention provides a method and appara- nF?rR TPTlOM OF ™ P np A WIfJ< ™ 

tus that will successfully perform a two-color analysis, BRIEF DESCRIPTION OF THE DRAWINGS 

for example, a Feulgen staining technique for the im- 60 In the Figures of the drawings, like reference numer- 

munoploidy analysis which classifies cells based on a als identify like components, and in the drawings: 

blue color for DNA in the nucleus and a red chromogen FIG. 1 is a pictorial representation of an image analy- 

for monoclonal antibodies. In an ionic staining tech- sis system constructed in accordance with the inven- 

nique, a methyl green staining agent is used to combine tion; 

with a cell component in the nucleus and a Diamtnoben- 65 FIGS. 1-A-l-D illustrate different histograms for 

zidene (Peroxidase-monoclonal antibody) combines aneuploidy analysis; 

with a component in the cytoplasm. In a third staining FIG. 2 is a functional block diagram of the image 

technique, the methyl green is used to combine with the analysis system illustrated in FIG. 1, which is adapted 
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to perform the quantitation methods for nuclear ONA 
in accordance with the invention; 

FIG. 3 is a schematic block diagram of the image 
acquisition apparatus of FIG. 2; 

FIG. 4 is a functional system diagram illustrating the 
major operations of the system control of FIG. 2; 

FIGS. 5 and 6 are top perspective and cross-sectional 
views, respectively, of a microscope slide particularly 
adapted for use in the image analysis system illustrated 
in FIG. 1, and having separate areas for calibration cell 
objects and specimen cell objects; 

FIG. 7 is a microscopic pictorial view of the binding 
effects of a monoclonal antibody; 

FIG. 8 is a graphical representation of the percentage 
of light transmission as a function of light wavelength 
for two stains and the two color filters utilized in accor- 
dance with the invention; 

FIGS. 9, 10, and 11 are pictorial representations of 
images of a cell population illustrating an unfiltered 
image, a red filtered image and a blue filtered image, 
respectively; 

FIG. 12 is a functional flow chart of one preferred 
method of quantifying DNA for human carcinoma in 
accordance with the inventions; 

FIG. 13 is a pictorial representation of the image 
monitor display during the selection process and illus- 
trating the marked cells; 

FIG. 14 is a pictorial representation of the multiple 
optical fields on the slide illustrated in FIGS. 5 and 6; 

FIG. 15 is a pictorial representation of a calibration 
screen appearing on the instruction monitor illustrated 
in FIG. 1; 

FIG. 16 is a pictorial representation of the analysis 
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DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 

Apparatus Structure 

The apparatus specifically illustrated in FIGS. 3 and 
23-28 and the methods described herein can be utilized 
to develop histograms and other statistical data of cell 
populations, which may find particular application in 
the diagnosis and prognosis of diseases. A specific ex- 
ample of this analysis capability is the quantity and 
distribution of the nuclear DNA, including the distin- 
guishment of particular proteins at protein sites and the 
DNA nucleus. 

The apparatus of FIGS. 23-28 has fewer reflective or 
refractive surfaces for light impingement than previous 
structures, thus minimizing light beam attenuation. The 
ease of adjustment of the light beam or light beam path 
assists in focusing the video cameras while providing 
more efficient use of the available light. 

In FIG. 1, apparatus 11 includes a digital image anal- 
ysis and processing system 13, which is broadly shown 
in FIG. 2. Apparatus 11 includes a high-resolution mi- 
croscope 15 for viewing magnified specimens on a sup- 
port or stage which may include a glass slide 14. Micro- 
scope 15 has an adjustment or positioning means 70 for 
focusing optics, such as a condensing lens, on slide 14, 
and further includes a platform 51 incrementally mov- 
able in the X and Y directions through positioning 
means 12 and 17, respectively, to view the total area of 
slide 14. Positioning means 12, 17 and 70 may be me- 
chanical adjustment verniers for microscopes. 

The specimens, which may be cells mounted on the 
slide, are in the field of view of the magnifying micro- 



screen which appears on the instruction monitor of 35 scope, and are viewable or reviewable through an imag- 



FIG. 1; 

FIG. 17 is a system flow chart of the analysis system 
screen architecture for image analysis system illustrated 
in FIG- 1; 

FIG. 18 is a functional flow chart of the main menu of 40 
the main screen illustrated in FIG. 17; 

FIG. 19 is a functional flow chart of the calibration 
menu of the calibration screen of FIG. 17; 

FIG. 20 is a functional flow chart of the blue bound- 



ing system 13 with image acquisition apparatus 18 as 
well as being visible for analysis in the viewing optics or 
ocular lens 24. Apparatus 18 is operable to receive the 
light image at the intensity projected from the specimen 
field of view. Apparatus 18 thereafter converts the 
single light beam image into two analog signals [red, 
blue], which can be individually monitored, sampled 
and digitally processed by image analysis system 13. 
Image analysis system 13 is controlled by a system con- 



ary adjustment menu of the blue boundary screen ill us- 45 trol 22 in the form of a digital processor, such as a per- 



trated in FIG. 17; 

FIG. 21 is a functional flow chart of the red boundary 
adjustment menu of the red boundary screen illustrated 
in FIG. 17; 



sonal computer. 

An operator, such as a pathologist or laboratory tech- 
nician, interactively communicates with system control 
22 through a keyboard 36. The operator interacts with 



FIG. 22 is a functional flow chart of the analysis 50 the system to quantitate nuclear DNA, as well as clas- 



menu of the analysis screen illustrated in FIG. 17; 

FIG. 23 is a top plan view of a diagrammatic repre- 
sentation of an alternative embodiment of the image 
acquisition apparatus of FIG. 3; 

FIG. 24 is a top plan view of a diagrammatic repre- 55 
sentation of the image acquisition apparatus of FIG. 23; 

FIG. 25 is a first side plan view of one side of the 
apparatus illustrated in FIG. 24; 

FIG. 26 is a second side plan view of the apparatus 
illustrated in FIG. 24; 

FIG. 27 is an exploded view of the image acquisition 
apparatus in FIG. 23; and 

FIG. 28 is a second alternative embodiment of the 
apparatus shown in FIG. 23; and 



sify cell objects, by review of two displays or monitors 
37 and 62. Image monitor 37, which is the first display, 
is a conventional RG beam video monitor providing a 
display through system control 22 and image acquisi- 
tion apparatus 18, which is the same image provided 
through a field of view by ocular lens 24. The second 
display is provided through instruction monitor 62, 
which is a second conventional RG beam video monitor 
providing the operator with interactive prompts, im- 
60 ages, information and instructions from a system pro- 
gram executed by system control 22. 

Keyboard 36 is illustrated as a conventional AT type 
keyboard having the following: a plurality of function 
keys F1-F10; a plurality of alphanumeric keys includ- 



FIG. 29 is a graphical representation of a nuclear 65 ing special function keys such as ENTER, SHIFT, 



antigen measurement spectra; and 

FIG. 30 is a graphical representation of a dual-stain 
cell spectra transmission. 



CONTROL and ALTERNATE; and, cursor control 
keys including an up/down left/right arrow key, a nu- 
meric keypad, a numeric lock key and an escape key. 
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Keyboard interface 35 translates the keystrokes of the 
operator into numeric codes for system control 22. 
Printer 38 is provided to reproduce reliable hard copy 
output of statistical data and reports generated through 
apparatus 11. 

Image analysis and processing system 13 is illustrated 
in FIG. 2 t which is a functional schematic of apparatus 
11. Processing system 13 can analyze a plurality of 
specimen cell objects or components from the image in 
the field of view provided through microscope IS of the 
plurality of cells on slide or support 14. The image 
provided through microscope 15 includes light commu- 
nicated from a variable or fixed intensity source 19 
transmitted through slide 14 and thereafter resolved 
through microscope optic or objective lens 16. As 
shown in FIG. 1, microscope 15 is a compound micro- 
scope with objective lens 16 and ocular lens 24, which 
may be adjusted by means known in the art. 

Light source 19 transmits light of a relatively broad 
band spectrum in the visible range or band of light 
through the cell objects or plurality of cells on slide 14. 
The optical density of the image converts the light from 
source 14 into a different intensity output beam commu- 
nicated to objective lens 16, which differential intensity 
is dependent upon the percentage of light transmission 
or, conversely, the percentage of light absorption by the 
cell object. The visible indication of this phenomenon is 
presented by the areas of slide 14 wherein no cell ob- 
jects exist, and therefore these areas will transmit light 
of high intensity [transparent], whereas areas having 
nontransmissive or less transmissive objects will appear 
darker. Generally, an unmodified cell or cell object is 
relatively transparent and the features of these cells or 
cell objects are almost indistinguishable. Therefore, the 
practice of staining cell objects optically enhances the 
features or objects within the individual cells to high- 
light or darken them over surrounding features and/or 
background. In the present invention the stains may be 
bound to the particular cell by any mechanism, such as 
absorption, adsorption, ionic bonding, covalent bonding 
or other method. 

The image from each of the cells or cell objects on 
slide 14 is projected or transmitted to image acquisition 
apparatus 18 through an optical image splitter 25. Split- 
ter 25 partially reflects the transmitted image to the 
image acquisition apparatus 18 or the other detector, 
such as ocular lens 24. Splitter 25 communicates ap- 
proximately, as a preferred embodiment, 90% transmis- 
sion of the transmitted light from slide 14 to image 
acquisition apparatus 18 for subsequent conversion t o 
the optical image for the two scanned electronic signals 
[eg., red, blue] through a point-by-point electronic anal- 
ysis, which represents a monochromatic image of the 
optical intensity of each of these points in the image 
communicated to splitter 25, that is, a true color image 
of the field provided to the analyst at viewing optics 24. 

FIG. 3 illustrates an embodiment of the several ele- 
ments of image acquisition apparatus 18, which includes 
reflecting mirrors, an image splitter, filters and video 
cameras, including a digitizing network. As noted 
above, the light from variable wavelength source 19 is 
transmitted through slide 14 with a cell or plurality of 
cells thereon and communicates an image to beam split- 
ter 25', which is mounted in a holder 53. A first true 
color image is communicated from beam splitter 25 to 
the viewing optics or ocular lens 24 for focusing and 
manual review thereof. In addition, a second true color 
image is transmitted by beam splitter 25 perpendicular 
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to the vertical path from slide 14 to a focusing lens 154 
and image acquisition apparatus 18. Lens 154 provides a 
focused image, that is, a real image, to the image acqui- 
sition apparatus 18. 

5 Image acquisition apparatus 18 includes: a plurality of 
optica] elements including a second beam or image 
splitter 156; reflecting mirrors 158, 160, and 162; and, 
two monochromatic optical filters 164 and 166. Image 
acquisition apparatus 18 also includes first video camera 

10 168 and second video camera 170, which receive sepa- 
rate portions of the projected image from second image 
splitter or beam splitter 156. 

The projected image-carrying beam from objective 
lens 16 and first beam splitter 25 is communicated to 

15 both the microscope optics or ocular lenses 24 and to 
second beam splitter 156. In a preferred embodiment, 
second beam splitter 156 communicates approximately 
all of the light above a predetermined wavelength for 
reflection by mirror 158 through optical filter 164 to 

20 first camera 168. Similarly, the light beam wavelengths 
below the predetermined wavelength are communi- 
cated to reflecting mirrors 160 and 162 for reflection 
through second filter 166 to second camera 170. Filters 
164 and 166 are narrow bandpass filters, which filter the 

25 light beams transmitted therethrough to substantially 
provide a light frequency at a specific wavelength. 
Filters 164 and 166 operate within narrow specified 
limits and provide an optical block to wavelengths out- 
side this narrow band of wavelengths. Thus, the light 

30 beams provided to first and second cameras 168, 170 are 
essentially monochromatic images of the field of view 
on slide 14. Filters 164 and 166 may be changed and 
selected for either color or wavelength operability, and 
thus second filter 166, for example, may be a blue filter 

35 with a narrow bandwidth different than the width of 
filter 164. That is, first filter 164 may operate at a wave- 
length such as 620 -10 nanometers, and second filter 
166 may operate as a blue filter with wavelengths near 
500 ± 10 nanometers. 

40 Each video camera or sensor 168, 170 is operable to 
convert the monochromatic, optical, light-carried 
image of slide 14 on a point-by-point, that is, digital, 
field into a scanned electronic signal representing the 
optical intensity or density of each point pixel, in this 

45 light image. The output of the first and second cameras 
168, 170, which is formatted as a standard NTSC analog 
video signal, is communicated to an analog or digital 
convener of a pair of image processing interfaces 21, 23 
(cf. FIG. 2), for conversion to a digitized signal, which 

50 is received and stored by system control 22. As the 
image under review on slide 14 is continuously scanned, 
a real-time image of the area under review is provided 
by image display 37. In the above-noted Feulgen stain 
example, dual camera arrangement 168, 170 provides a 

55 red color image and blue color image, respectively, 
simultaneously to the control system, which images 
may be mixed to provide a combined or focused image 
of the field of study. Each monochromatic digital image 
is stored as a 5 1 2 X 512 array of pixels, where each pixel 

60 has a measured light intensity of 0 to 255 [8 bits]. 

The parfocal arrangement on either side of first image 
splitter 25 allows the same or similar image to be re- 
viewed through the ocular lens 24 or on image display 
37. The platform 51 may be positioned by the manual X, 

65 Y adjustment positioning means 12 and 17 as the opera- 
tor views a field or Teviews a slide to provide a field of 
interest thereon. Thereafter, the computer-enhanced, 
digitized image of the selected field is displayed on 
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image display 37 for further analysis. An X-position functions of blocks 82-86 to control the hardware of 
sensor 26 and Y-position sensor 27, shown in FIG. 2, apparatus 11 for performing a particular function. This 
generate location or position signals to position inter- system provides the following: a patient or cell labeling 
face 34 on lines 26a and 27a respectively, which digi- function 82 to identify the particular tissue samples 
tizes these signals to provide apparatus 11 with an accu- 5 under study; light calibration and position calibratiop 
rate coordinate representation of the field of study. functions 84 and 86, respectively, which are utilized to 
Thereafter, the field under review may be reselected at provide an accurate reference optical density for a pax- 
a later date for additional study without scanning the ticular field and location of such field with respect to a 
total slide in anticipation of possibly locating the same coordinate origin; control cell calibration 88 operating 
or similar field of view. 10 to provide a datum or reference for the various back- 
Displays 37 and 62 are controlled by system control 2 ground stains, DN A index calibration, or other func- 
through standard video monitor interface circuitry 39 tion; a boundary formation 90, allowing the operator to 
and 61, respectively. Similarly, keyboard 36 and printer select a reference level for the gray scale value for 
38 communicate with system control 22 through con- comparison of either the red or blue image; a selected 
ventional interface circuits 35, 41, respectively. System 15 cell marking function providing marking of the cells 
control 22 controls a random access memory and other identified by cytoplasm optical enhancement in the 
bulk memory storage devices in the form of either acquired data function; cell data function 92 for storing 
floppy and hard disk arrangements or drives 75 through of gray scale value of the specimen image measurement; 
a memory control interface 71. cell classification function 93 operable for the operator 
Interface circuits 21, 23, 34, 35, 39, 41, 61 and 71 can 20 to classify the acquired cells, and cell analysis function 
be selectively provided on a printed circuit board or 94 providing different statistical analyses of categorized 
boards mounted in the back plane or card connector of data; a utility function 95 providing the needed auxiliary 
a conventional personal computer integral with or type program for assisting in primary function of image 
forming system control 22. For example, the personal analysis; and, a report generation function 96 to provide 
computer can be one manufactured by IBM corporation 23 hard copy production of the analyzed and compiled 
with a model designation AT, or a similar model com- data from the system onto or by printer 38. 
patible therewith. This control system 22 can be oper- The specimen support is preferably a transparent 
ated under a disk operating system such as PC DOS, glass slide 14, as illustrated in FIGS. 5 and 6, which 
Version 3.1 or later-issued programming. The system slides come in standardized sizes, such as 1 in. X 3 in. 
software for the image analysis may be provided on any 30 dimensions. In the present instance, slide 14 may be 
storage and/or operating means, such as disk drive 75, provided with or partitioned into two sections, with a 
. or a hard disk, and could thus be introduced into the first control section 56 having control cell objects 40, 
computer operating system by a means such as a floppy and a second section or specimen section 58 for receiv- 
disk 77. The system software would be read from disk ing the cell specimen 52, which may be analyzed and 
77 and loaded into ram 73. Thereafter, the program 35 measured for DNA content or other constituent. Slide 
control would be transferred to system software from 14 may include a border 54 around the control section 
the operating system to regulate the various hardware 56 for rapid identification thereof, and at some conve* 
elements of apparatus 11, which were previously set. nient location of slide 14, an identifying mark 53, shown 
Image analysis system 13 provides an interactive as a cross in FIG. 4, may be utilized as a landmark or 
program control which projects a number of instruction 40 coordinate origin for the slide field, 
screens or images on instruction monitor 62 to assist the Apparatus 11 may be utilized in various offices by 
operator in the quantitation of nuclear DNA found in persons of varying degrees of skill for image analysis, 
one or several cells or subpopulations displayed on Microscope light source 19 may be adjusted by different 
image monitor 37. Interactive responses by the operator operators to vary the light intensity and in addition, the 
and the menu selections for the different instruction 43 very nature of the lamp may vary from machine to 
screens will thus function to perform the image analysis machine as well as depend upon the age of such lamp, 
of the projected image on monitor 37. Therefore, it is necessary to provide a calibration func- 
The system functions are more fully illustrated in tion for the light intensity to eliminate or minimize 
FIG. 4, where software control logic functions for the errors, or to accommodate the variation in such light 
hardware of block 80 communicate with software anal- 50 intensity. In addition, the staining rate or the quantity of 
ysis and measuring functions of the system software of stain utilized may cause a variation in the staining fac- 
blocks 82-96. The software performs an initialization tor, which may be a function of the utilized volume of 
operation, an interfacing of the operating system func- the particular stain. Such variation in stain levels causes 
tion, and overall control of the apparatus by instrument a variation in the gray level output viewed through 
control logic. An image and instruction monitor control 53 microscope 15 by cameras 168 and 170, which gray 
logic performs screen handler operations for the in- level is utilized to analyze the particular components, 
st ruction screens and digital display of digital images of such as DNA content. Consequently, apparatus 11 must 
the specimen for both monitors 37 and 62. Memory and be calibrated to eliminate the variable differences to 
disk storage functions are operated or controlled by the provide a true indication of the actual component 
software and memory control logic. Input and output 60 amount, 
for the interactive responses, as well as report genera- . . 
tion, are handled by the keyboard and printer control Staining 
logic. Data from cameras 168 and 170 as well as position The cell staining techniques may be broadly classified 
sensors 26 and 27, are handled by image acquisition in at least three categories: 

control logic and position acquisition control logic, 65 1) immunohistochemical staining, which may be 

respectively. based on monoclonal antibody attraction or reaction; 

The control logic of the software forms an operating 2) strong chemical binding, such as Feulgen staining, 

shell, which is utilized by the analysis and measuring and characterized by high stain affinity and/or covalent 



03/30/2004, EAST Version: 1.4.1 



5,134,662 

11 12 

binding, which may be indicated by the acid hydrolysis Biotin, alkaline phosphatase reagent, and a chxomogen 

of DNA; and, substrate (preferably fast red). Similarly, the Feulgen 

3) Ionic staining associated with strong coulombic staining technique utilizes Thionin reagent solution and 

forces and electrostatic interaction, which may be indi- a rinse agent. In this method, the slide containing con- 

cated by a dye-tissue reaction. 5 trol cells and specimen cells in sections 54, 58, is first 

Examples of the above type-one staining may be red stained with the alkaline phosphatase process to opti- 

chromogen or enzymatic alkaline phosphatase or cally enhance a specific cytoplasmic antigen, 

diaminobenzidene alkaline peroxidase. In type two, the In FIG. 7 f the representation of a particular antigen 

Thionin for the Feulgen staining technique for nuclear site 180 labeled AR is illustrated as marked and ampli- 

DNA is exemplary of the strong chemical binding tech- 10 fied. The site is antigenic against a primary antibody 182 

nique. Finally, the type three staining means is exempli- bound thereto. A bridging antibody 184 against the 

fied by ethyl green stain, hematoxylin, methyl blue or primary antibody is used to bind to the primary anti- 

eosin. An oncogene type of stain may have the charac- body, and has affixed a Biotin molecule 188. Avidin- 

teristics of types one and two above, or it may also be Biotin complex, including an Avidin molecule 186 and 

represented by types one and three. The clear-cut or 15 three Biotin molecules 188, are added to the bound 

clearly discernible characterization is not as obvious in primary and bridging antibodies. The Biotin molecules 

this case. 188, are conjugated with molecules of alkaline phospha- 

The sources of staining affinity noted above are re- tase AP enzyme 190. The fourth Biotin molecule site is 
ferred to as stain-cell attractive forces. The forces can open for binding the complex to the bridging antibody 
be illustrated by attractive coulombic forces, Van 20 184. When a dye, such as fast red molecules 192 in 
derWaal force attractions (especially relevant with po- solution, is added to this mixture, the alkaline phospha- 
larizable materials with large electric dipoles), stain- tase reacts with the dye molecules to produce insoluble 
stain attractions having a complex formation and en- fast red molecules 194, which mark the antigen site, 
tropy effects. Other factors affecting staining and stain- While this Avidin-Biotin complex is exemplary, any 
ing selectivity include variations in tissue substrate 25 number of marking techniques and stains may be uti- 
amount; differential stain-cell binding, which can be lized, as noted below. Alternatively, a bridging or pri- 
efTected by differential rates of stain penetration into mary antibody, which is anti-alkaline phosphatase, will 
cellular structures; and selective coloration of bound be utilized and amplified by fast red dye in the previous- 
stain. In addition, there are at least the following techni- ly-described manner. 

cal variables affecting staining: structure of the staining 30 In the above-noted Feulgen staining alkaline phos- 

reagent; nature of the solvent; presence of co-solutes; phatase methods, the apparatus for the present method 

temperature; and time. A more expansive discussion of provides a dual filtering method to distinguish the areas 

staining and staining mechanisms may be found in stained by the red chromogen [cytoplasm] and the areas 

"Standardization and Quantitation of Diagnostic Slain- stained by the blue Thionin [DNA]. These different 

ing in Cytology," edited by M. E. Boon and L. P. Kok. 35 images, one provided by the red filter and the other by 

The calibration material 40 is provided on slide 14 for the blue filter, separate the DNA stained area from the 

review by the operator or analyst to establish a calibra- cytoplasm area, which contains the specific antigen, and 

tion or reference position prior to analysis of the un- also separates both areas from other cell or field fea- 

known cell or specimen 52. As shown in FIG. 5, slide 14 tures. The method uses selective filtering both above 

has control cell objects 40 and specimen cell objects 52 40 and below a wavelength through beam splitter 156, and 

positioned thereon for simultaneous staining of collec- thereafter filtering these selective wave length images 

tions of cells. This simultaneous staining of both the by a color filter technique with a narrow bandpass, 

calibration material 40 and the cells under analysis 52, which provides maximum utilization of available light 

permits comparison of these two classes or groups of intensity and minimizes the light intensity for filtering to 

cells to a predetermined and stored reference light in- 45 each of the separate filter elements 164, 166 to improve 

tensity, gray level or optical density, of the control cell their efficiency. 

objects after staining. If the cell objects are stained Illustrative of the technique is the result shown in 
either too lightly or too heavily, the difference can be FIG. 8, which is a DNA gating technique. The percent- 
compensated for during the quantitative analysis. age of light transmitted through the nuclei stained with 
In this exemplary illustrated embodiment, control 50 the Thionin dye is noted as Curve A, which is a function 
cells 40 are rat liver cells of a known size, shape and of the wavelength of light. The percentage of transmis- 
DNA content. The control cell objects may be various sion of the light for the fast red dye is noted as Curve B, 
other cells with dark centers or nuclei that stain well, which is also a function of the light wavelength. The 
such as chicken blood cells or trout cells. Alternatively, bandwidth of wavelengths of light passed by the blue 
cell objects may be artifacts printed on the slide or 55 filter 166 is illustrated in Band C, and the bandwidth of 
having a cell shape; or the cell objects may be conven- wavelengths transmitted or passed by red filter 166 is 
tional plastic beads of a predetermined size, which will noted as Band D. 

react with a particular fluorescent or enzyme stain It is noted that Curve A, the Thionin dye curve, has 
when treated simultaneously with specimen cell ob- approximately its minimal transmission, or is relatively 
jects, such as monoclonal antibodies. The reference cell 60 nontransmissive at approximately a 480 nanometer 
objects will vary between tests and the present inven- wavelength, while the fast red dye curve, B, is rela- 
tion is not limited to a particular test or cell object. . tively transmissive at this band range. Later work has 
In the particular example noted above utilizing the indicated that for the present invention the analysis 
Feulgen staining technique, slide 14 with the control should be performed at about 500 nm, which conforms 
cell objects thereon arc stained with a dual staining 65 with other analytic techniques noted below. Thus, 
technique. In this example, an alkaline phosphatase when the image of the cell population is filtered through 
staining technique utilizes a primary antibody reagent, a blue filter 166. substantially all of the area stained with 
biotinalated secondary antibody reagent, an Avidin- fast red dye will be essentially transparent and substan- 
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Dally all the area stained with Thionin dye will be visi- 
ble. Therefore, the areas provided with Feulgen stain 
can be separated from the cytoplasmic stained areas. 
Similarly, at approximately the band wavelength 
around band D of red filter 164, the inverse operation is 5 
provided. That is, Thionin curve A is relatively trans- 
missive at this bandwidth, while fast red dye curve B, is 
relatively nontransmissive. Thus, the cytoplasmic areas 
containing fast red dye are identifiable and are clearly 
distinguishable from the DNA nuclear areas with the 10 
Feulgen stain. 

The above-noted illustration at FIG. S indicates that 
the maximum-minimum relationship of the curves A 
and B are not precisely overlapping. However, there is 
a great enough separation between the curves, that is IS 
the percentage of transmission difference, to allow the 
system equipment to provide a clear analytical repre- 
sentation to the monitor for study, analysis and quantifi- 
cation of the cell or cells. 

It is apparent that opposite relative differences in the 20 
light transmission of the two stains with their reactive 
components, provide selective areas for filtering. Thus, 
a convenient and advantageous method for discriminat- 
ing between these areas with separate staining is pro- 
vided, and it is recognized that various other staining 25 
pairs or conditions may be utilized for different cells 
and/or cell components to provide similar results for 
discriminating and distinguishing various cell features. 

The system software for DNA analysis in the above 
example can now determine the mass of cellular DNA 30 
through optical density measurement of the specimen 
cells from the Thionin stain through instrument 11. The 
mass of the DNA of a stained cell object may generally 
be obtained from its optical density through the Beer- 
Lambert law which is well known in the art of micro- 35 
spectrophotometry. This analysis provides the mass 
distribution of a cell or number of cell objects which are 
available thereafter for analysis by statistical basis, his- 
togram or other analytical format. The spot size, A, 
noted for the above Beer-Lambert law, is determined by 40 
the number of pixels measured by one of cameras 168, 
170. The optical density for each pixel is calibrated by 
adjusting the light level, focus, and reading a reference * 
optical density for the calibration cells 40 on the slide. 
This calibration allows conversion of the measured 45 
light levels for each pixel into an optical density, a di- 
mensionless quantity. The calibration for the extinction 
coefficient of the above-noted equation is provided by 
measuring the optical density for a plurality of control 
cells 40 to provide a peak for the distribution in relative 50 
mass units. As the peak DNA content is known for the 
control cell distribution, the cells in the field of the 
unknown specimen can be measured using the relative 
OD units, and thereafter converting these directly into 
picograms by comparison to the control cell calibration. 55 

FIGS. 9-11 are pictorial representations as follows: 1) 
FIG. 9 is the true color image of a field of a slide 14; 2) 
FIG. 10 is an image filtered with the red filter; and 3) 
FIG. 11 is an image filtered with the blue filter. FIG. 12 
is a flow chart of the steps in the method of the present 60 
invention to produce quantitation of nuclear DNA. 

FIG. 9 illustrates several cells of a subpopulation 
from one of the fields of microscope slide 14. This sub- 
population contains different types, wherein specific 
cells 202, 204 have been optically enhanced by the alka- 65 
line phosphatase staining noted above. All cells 200, 
202, 204, 206 and 210 have had the DNA in their nuclei 
optically enhanced by Feulgen staining with Thionin 
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dye. It is noted that this technique is exemplary and not 
a limitation. The light beam carrying the image from 
beam splitter 156 is projected through red filter 164. 
The image is provided in FIG. 10 and illustrates that 
only those areas containing fast red dye are visible. 
These are the cytoplasmic areas 212, 214 of cells 202, 
204, respectively, which have been optically enhanced 
by the staining techniques as they contain a specific 
antigen that combines with the monoclonal antibody of 
the alkaline phosphatase stain technique. Cells 202, 204 
are different than cells 200, 206, 208 and 210, which are 
not visible in this image. Further, the nuclei of all cells 
200, 202, 204, 206, 208 and 210 are not distinguished or 
visible in the background, as the optical separation of 
the Thionin dye and the fast red dye render them essen- 
tially transparent. 

Conversely, FIG. 11 illustrates the result of project- 
ing the image from beam splitter 156 through blue filter 
166, wherein all the nuclei of the several cells, e.g., 216, 
226, from the cell population are visible. In this image, 
the blue filter provides an exclusion of the stained cyto- 
plasmic areas, which are not nuclear stained, and are 
thus optically different, although stained, and thus 
transparent. 

The areas stained above the threshold set for each 
filtered image can then be combined by digital overlay- 
ment of the DNA image upon the cytoplasmic image, 
which presents a clear image of the DNA nuclear areas 
to monitor for typing and analysis where certain cells 
302, 304 are marked as to type by an identifying cyto- 
plasmic ring or crescent on the nucleus in FIG. 13. The 
DNA analysis then proceeds by interactive classifica- 
tion of each cell in the image displayed in the image 
monitor 37. Specifically marked cells 302, 304 can be 
included in any class, excluded from any class, or sepa- 
rately classified. Further, it is evident that different 
optical enhancements and filterings will give rise to 
different cell typing and increased sensitivity of the 
classification process. 

The method of measuring and analysis of DNA using 
the marking technique of the invention is more fully 
illustrated in FIG. 12. In a first step in block 250, a slide 
containing control cell objects and specimen cell ob- 
jects is stained with the above-noted alkaline phospha- 
tase technique utilizing fast red dye. The monoclonal 
antibody is specific against the cytoplasmic antigen, for 
example, leukocyte common antigens or Cytokeratins. 
The next step in the process is to stain the slide 14 with 
the above-noted Feulgen process, utilizing Thionin dye 
as noted in labeled block 252. After mounting, slide 14 
is placed on platform 51 of instrument 11 and positioned 
to provide a clear field on image monitor 37. The light 
level is then set, as provided in step or block 254 of the 
flow chart. 

Platform 51 is adjusted or traversed to control cell 40, 
or an image of a subpopulation of the control cell or 
cells appears on monitor 37 (block 256 of FIG. 12]. The 
image is that of the filtered image [redjshowing only 
Feulgen stained areas. The amount of staining to deter- 
mine the DNA index therein, for determination of the 
mass through optical density, is found by measuring the 
optical density of the control cells [block 260]. Gener- 
ally, the calibration is repeated to obtain an accurate 
measurement and assessment of the calibration and the 
process is repeated merely by iterating through the 
steps in blocks 260 and 262. In block 262, the platform 
51 may be manually adjusted to another location to 
provide a second field of control cells. 
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The peak of the optical density units is measured, The calibration menu. FIG. 19, provides means for 

convened into a DNA index, which index is stored in setting the current image or field location as the origin, 

the computer memory. The DNA of the unknown cell by zeroing a pair of location registers in the software, 

sample is thereafter analyzed from specimen section 58 The measure function A42, controls the control cell 

of slide 14, which has been positioned under the focal 5 or control object calibration to normalize the staining 

lens of the microscope by manual adjustment of plat- factor. During control cell calibration, the operator 

form SI. moves the microscope stage by adjustment of the X and 

A cytoplasmic image of the specimen field may be Y knobs 12, 17, respectively, to shift cell objects 40 into 
obtained utilizing the blue filter [block 266] and its the field of view on image monitor 37. 
boundary [block 268]. Similarly, a DNA image of the 10 Additional functions are provided on the various 
specimen field is provided through the red filter [block screens for various operations of the process. These 
270] and its boundary set [block 272]. These filtered include: the X-Y function to aid in the positioning of 
images are real-time images of the field and may be platform 51; the FOCUS-1 function A40 to provide 
constantly updated through image acquisition means 18 color enhancement to the image; the analyze function, 
of system 11. Apparatus 11 combines the two filtered 15 which provides a menu function shown in FIG. 22, to 
images [block 274] to mark the selected cells on image perform the DNA measurements on the cellular mate- 
monitor 37 while displaying the nuclear DNA area. The rial; the check light-2 function A82 calculates the light 
analysis program then proceeds to the classification step level of the current image; the select-second function 
[block 276]. In the classification mode, the image acqui- A84 permits the user to select the second peak on the 
sit ion and combination [marking] ceases and a static or 20 histogram displayed on an analysis screen; the classify 
fixed image is projected on image monitor 37. function A78 allows the user to classify the cells or 

The cells in the image on monitor 37 are classified by objects on image monitor 37; the display X, Y function 
type through an interactive process with an operator. A 88 changes the display from the analysis screen to the 
Each cell is noted by the apparatus and the operator X, Y field coordinates screen; the clear-2 function A90 
selects a classification for the separate cell using nuclear 25 clears all analysis-related areas of data; the focus-2 func- 
morphology and cytoplasmic markings of the combined tion A80 provides color enhancement; the area 1-2 func- 
irnage. Classified cells are then measured for the cell tion A86 allows the user to specify two areas in the 
component, such as DNA content, [block 278] and the histogram displayed on the analysis screen, 
results of the measurements may be displayed [block It will be appreciated that the various stained cell 
280]. This measurement display can be accommodated 30 calibration steps may be eliminated or combined and 
in several forms and with statistical analyses of the performed simultaneously, rather than in the above- 
different classifications or combinations of such classifi- described order, sequence and manner, 
cations. 

The measurement step can include more than the °P t,cs and ^1™?™** Alignment 
cells in a single field simply by iterating through the 35 In FIG. 3, the image acquisition apparatus 18 encom- 
steps noted in blocks 280-284 in FIG. 12. The operator passes a beam splitter 25 secured and mounted in a 
may manually move platform 51 to another specimen holder 53, which holder also secures focusing lens 154. 
field, and the marking and imaging steps may again be The focused and magnified image provided from the 
repeated as described above. The accumulated data in light source 19 and microscope 15 enters beam splitter 
the measuring steps for the new cell populations is com- 40 25 mounted in holder 53. Beam splitter 25 provides an 
piled with that of the previously developed cell popula- image for manual observation of the cell under analysis 
tion data. The display step noted in the above descrip- through the viewing optics or ocular lens 24 as well as 
tion can be delayed until a significant or required apparatus 18. In FIG. 3, holder 53 and beam splitter 25 
amount of data is accumulated, or display of each itera- are generally centrally located to project a magnified 
tion may be provided at the option of the operator. In 45 image light beam along the longitudinal axis of the 
addition, the operator may elect to bypass setting the image acquisition apparatus 18 and has second beam 
cytoplasm boundary and DNA boundary after they splitter 156 likewise aligned on this longitudinal axis, 
have been first set for a specimen image. This FIG. 3 system provides a light path to the cameras 
FIG. 17 illustrates the screen architecture of the sys- which is longer than desirable, as it requires reflecting a 
tern and the alternative paths that the system takes be- 50 light beam of lower intensity than the beam from first 
tween screens. Examples of two of the system screens, beam splitter 25. Consequently, an alternative path is 
the calibration screen A 14 and analysis screen A 16, provided, as noted in FIG. 23, to initially reflect the 
which appear on instruction monitor 62, are pictorially higher intensity polychromatic beam, thereby provid- 
illustrated in FIGS. 15 and 16, respectively. ing a more uniform beam intensity to both video cam- 
In FIG. 17, the system program may be run by an 55 eras. That is, second beam splitter 156, which may be a 
application program of the operating system A10. Se- dichroic beam splitter, divides the higher intensity first 
lection of the system program from the operating sys- light beam into two light beams of approximately equiv- 
tem A10 produces menu A 12 on monitor 62. From main alent intensities. This arrangement provides more 
screen A 12, the operator can select a calibrate screen closely matched beams at the video cameras, which 
A14, an analysis screen A 16, or exit back to the operat- 60 reduces the adjustments required to balance the overall 
ing system A10. The apparatus 11 can be calibrated to image system. A further benefit of this structure is a 
provide the background or reference-like settings for more compact assembly with easily adjustable compo- 
the measurement in the assay during the display of cali- nents in the optical circuit 

bration screen A14 on monitor 62. After completion of In FIG. 23, image acquisition apparatus 18 is illus- 

the calibration operation, the operator can select the 65 trated in a generally rectangular outlined manner with a 

analysis screen A 16 from the menu, which subroutine longitudinal axis 19, which is parallel or generally paral- 

A16 is utilized for measurement and classification of the lei with the longitudinal axis 169 of first video camera 

cell objects of the assay. 168 and axis 171 of second Video camera 170. In this 
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alternative embodiment, focus lens 154 is positioned in 
holder 53 at a location perpendicular to longitudinal 
axis 19 to receive light beam 153 carrying the magnified 
image from beam splitter 25. This image or light beam 
153 is projected through focus lens 154 to first mirror 5 
160, for reflection to second mirror 162 and second 
beam splitter 156. In this configuration, the image or 
light beam 153 is projected normal to axis 19, reflected 
at first mirror 160 at about a right angle to second mir- 
ror 162 and again reflected at a right angle for commu- 10 
nication of the magnified image to the second beam 
splitter 156, which second reflection from second mir- 
ror 162 is illustrated along a line parallel to the image 
line of first light beam 153. Thereafter, second beam 
splitter 156 splits the first light beam 153, which has 15 
only suffered attenuation from reflection, into a second 
light beam 157 and a third light beam 159. 

As noted, beam splitter 156 may be a dichroic beam 
splitter, that is operable to split or divide a first or im- 
pinging light beam into a second and third light beams. 20 
The second light beam may be transmitted light above 
a predetermined wavelength and the third light beam 
may be light reflected below the predetermined wave- 
length. The order of transmission-reflection through the 
beam splitter is not limited thereto, but is merely an 25 
example. A more expansive development of this phe- 
nomena may. be acquired by a topical review of light 
polarization and Nicol prisms in a standard or optic- 
related physics text. Dichroic filters or beam splitters 
may be selected to be operable at different predeter- 30 
mined wavelengths. 

As an example but not a limitation, light beam 157 is 
below a predetermined wavelength and is transmitted 
through first monochromatic optical filter 164 for com- * 
munication to and reflection from third reflecting mir- 35 
ror 158, which reflects light beam 157 at about a right 
angle, that is generally parallel to longitudinal axis 19, 
to first video camera or sensor 168 at the first camera 
front plane 173. Third light beam 159 is reflected by 
splitter 156 through second monochromatic light opti- 40 
cal filter 166 to second video or sensor camera 170 at its 
front plane 175. In this configuration it is noted that the 
light beams are projected or reflected at right angles or 
generally right angles to the intersecting or reflecting 
planes such that the beam essentially travels either par- 45 
allel to or perpendicular to longitudinal axis 19 of the 
image acquisition apparatus 18. First monochromatic 
optica] filter 164 and second monochromatic optical 
filter 166 are in proximity to the second image beam 
splitter 156, which arrangement provides the maximum 50 
intensity of the split image light beams and minimizes 
the potential attenuation suffered by communication of 
such beams by reflecting or filtering devices. 

As noted above, second image beam splitter 156 splits 
first light beam 153 into a continuous spectrum with a 55 
bandwidth below a predetermined wavelength, which 
is second light beam 157, and another continuous band- 
width spectrum above the predetermined wavelength, 
which is third light beam 159. These light beams are 
projected or communicated to first video camera 168 or 60 
second video camera 170, respectively. First light beam 
157 is provided to first camera 168 at its front plane 173 
through first monochromatic optical filter 164 and mir- 
ror 158. First filter 164 is specifically chosen to provide 
an approximately monochromatic optical image at a 65 
predetermined wavelength, that is, it filters out wave- 
lengths outside the first predetermined wavelength. 
Similarly, the second monochromatic optic filter 166 
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filters or selects a section of a light beam bandwidth at 
a predetermined wavelength for communication to 
second video camera 170 at its front plane 175. As the 
bandwidths of the light beams have been narrowed by 
second splitter 156, the filters are more efficient in selec- 
tively providing the selected wavelength light to cam- 
eras 168, 170. 

In FIG. 23, the separation distance from second 
image beam splitter 156 to the third reflecting mirror 
158 is noted as X; the distance from the third mirror X 
to front plane 173 of first video camera 168 is Y; and, the 
separation from second image beam splitter 156 to the 
front plane 175 of second video camera 170 is denoted 
as Z. In this configuration, the sum of the beam path or 
distances X +Y is equal to the distance Z. 

The image from the second beam splitter 156 to sec- 
ond camera 170 in this embodiment, is only projected 
through the second optical filter 166 and thus, the image 
or rather the intensity losses to the second video camera 
170 due to reflection or interference are minimized. In 
addition, optical filter 164 is in closer proximity to sec- 
ond image beam splitter 156 to enhance the image to 
first camera 168 by filtering a light beam which is not 
attenuated by distance or intermediate reflection or 
diffraction. 

In this embodiment, which is illustrated in detail in 
FIGS. 24-27, image acquisition apparatus 18 includes 
housing 402 which has a bottom panel 404, top panel 
406, front panel 412, rear panel 413 and, first and second 
sidewalk 408, 409. In FIG. 27, which is an exploded 
view of apparatus 18, housing members 404, 406, 408, 
409, 412, and 413 cooperate to define an enclosure or 
chamber 410 wherein the components of image acquisi- 
tion apparatus 18 are mounted and operable. Bottom 
panel 404 is essentially utilized as the mounting base for 
securing or maintaining the various operating compo- 
nents of image acquisition apparatus 18. In this illustra- 
tion, bottom panel 404 includes front panel 412 with a 
base 414 to receive the holder 53 for first beam splitter 
25 and focusing lens 154. Mounting base 414 defines a 
plurality of threaded holes 416 in alignment with 
through bores 418 of holder 53 to receive securing 
means 420, shown as threaded screws, which mate with 
threaded holes 416 to secure holder 53 on bottom panel 
404. 

Bottom panel 404 includes first pivot socket 422 and 
second pivot socket 424 as well as first threaded secur- 
ing port 426 and second threaded port 428 (cf. FIG. 25) 
communicating with first and second pivot sockets 422 
and 424, respectively. First reflecting mirror 160 is 
mounted on first mounting base 432, which has a first 
pintle 436. Second mirror 162 is similarly mounted on 
second mounting base 434 with second pintle 438 af- 
fixed thereto. First pintle 436 and second pintle 438 are 
positioned in first and second pivot sockets 422, 424, 
respectively, and first and second mirrors 160, 162 are 
rotatably adjustable in the sockets for positioning the 
reflection of the magnified image received from focused 
lens 154. After alignment of mirrors 160, 162, securing 
means 430 in ports 426 and 428 contact first and second 
pintles 436 and 438 to secure the mounting bases and 
mirrors. 

Second beam splitter 156 is mounted and operable in 
a frame 472 on a gimballed base 450. Bottom plate 404 
has a recess 440 with a recess sidewall 442 and a washer 
well 444 (cf, FIG. 24), which well 444 is at least par- 
tially open to recess 440. Washer well 444 includes a 
generally centrally positioned threaded port 446, and 
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bottom panel 404 defines a threaded pivot bore 448 in 
recess 440. Gimballed base 450 for beam splitter 156 is 
positioned in recess 440. Base 450 defines a generally 
centrally located cavity 452 and a gimballed base pivot 
passage 454 alignable with threaded pivot bore 448. 5 
Further, gimballed base 450 has first threaded hole 456, 
second threaded hole 458, and third threaded hole 460. 
Threaded pivot and securing pin 462 is operable to 
extend through pivot passage 454 and mate with 
threaded pivot 448 to secure gimballed base 450 in re- 10 
cess 440. However, pivot pin 462 also operates as a 
pivot Tor the gimballed base when it is not in its secured 
position. A spherical bearing 464 is positioned in central 
cavity 452 for slight rotational or rocking movement of 
the second beam splitter. In addition, a first vertical bias 15 
means 466, a second vertical bias means 468, and a third 
vertical bias means 470 are provided for vertically bias- 
ing beam splitter 156. Bottom panel 404 has a threaded 
locking port 491 communicating to recess 440 to re- 
ceive a locking screw 493. 20 

Second beam splitter 156 is mounted in mounting 
frame 472, which frame has first through passage 474. 
second through passage 476, and third through passage 
478 to receive first, second and third frame threaded 
securing means 480, 482, and 484 respectively. First, 25 
second and third passages 474, 476, 478 are alignable 
with threaded bores' 456, 458 and 460, respectively, of 
gimballed base 450. Mounting frame 472 is positioned 
on gimballed base 450 with first, second and third verti- 
cal bias means 466, 468, and 470 interposed therebe- 30 
tween and aligned with the passages 474, 476, 478 and 
threaded bores 456, 458 and 460, respectively, of the 
gimballed base 450. Thereafter, first, second and third 
threaded securing means 480, 482 and 484 are mated 
with the threaded bores 456, 458 and 460 through pas- 35 
sages 470, 476 and 478, respectively. 

Gimballed base 450 with frame 472 and splitter 156 is 
positioned in recess 440 with pivot and securing means 
462 mated with threaded bore 448 through pivot pas- 
sage 454, whereby gimballed base 450 may nominally 40 
pivot about pivot means 462 in recess 440. A lateral 
biasing means 486, which is positioned in recess 440 
between sidewall 442 and gimballed base 450 biases base 
450 around pivot pin 462. A washer 488 with a central 
passage 490 therethrough is positioned in washer well 45 
444 and contacts gimballed base 450 with a segment of 
its circumference. Thereafter, when the gimballed base 
is located in a preferred or oriented position, washer 488 
is secured by a bolt 492 mating with threaded bore 446 
through central passage 490. Threaded pivot and secur- 50 
ing means 462 cooperates with securing washer 488 and 
locking screw 493 to lock or secure second beam split- 
ter 156 in its preferred position against the lateral bias 
force of bias means 486. 

Third mirror 158 is mounted and adjustable on a 55 
second gimballed support 494, which has a mounting 
pedestal 496 and a vertical wall member 498 with third 
mirror 158 mounted generally parallel thereto. Wall 
member 498 has a first threaded aperture 500 and a 
second threaded aperture 502 with first and second 60 
threaded adjustment means 501, 503, respectively, 
therethrough to contact mirror 158. Mounting pedestal 
or foot member 496 has first and second securing 
through-ports 504 and 506, which are alignable with 
bottom plate first threaded bore 508 and second 65 
threaded bore 510, respectively. Gimballed support 494 
is mounted on bottom plate 404 with a pair of threaded 
bolts 512 through ports 504 and 506, and mated in 
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threaded bores 508, 510 respectively. Thereafter, mirror 
158 is adjusted by rotation of threaded adjustment 
means 501 and 503. 

Second optical filter 166 is mounted in second filter 
mounting frame 514, which includes second frame first 
and second through bores 516 and 518. Bottom plate 
404 defines a pair of second filter threaded bores 522 
and 524, which arc alignable with second frame bores 
(not shown) each receiving one of a pair of securing 
bolts 520 to secure frame 514 to bottom plate 404. Simi- 
larly, first filter 164 is mounted in a first filter mounting 
frame 526 with a first through bore 528 and a second 
through bore 530. Bottom plate 404 defines a pair of 
first filler threaded bores 534 and 536 alignable with 
first frame through bores (not shown), to receive one of 
a pair of securing bolts 532 therethrough to secure first 
mounting frame 526 to bottom plate 404. Mounting 
frames 514 and 526 are nominally adjustable prior to 
securing by bolts 520 and 532, respectively. 

In FIG. 27, bottom panel 404 includes a family or 
plurality of upstanding or upright braces extending 
generally vertically from bottom panel 404 into enclo- 
sure 410. More specifically, first upright brace 538 verti- 
cally protrudes into chamber 410 along or parallel first 
sidewall 408 and second upright 540 and third upright 
542 are generally centrally located on bottom panel 404 
along longitudinal axis 19 and extend into enclosure. 
410. Uprights 540, 542 are generally centered in enclo- 
sure 410 along axis 19. Bottom panel 404 further defines 
a slot 546 for second video camera 170 between first 
brace 538 and second and third braces 540, 542. Fourth, 
fifth and sixth upright braces or brackets 548, 550 and 
552 vertically extend from bottom panel 404 into cham- 
ber 410 along second sidewall 409. Brackets 548, 550 
and 552 are generally parallel to the centrally located 
second and third uprights, 540, 542, and cooperate with 
bottom panel 404 and central brackets 540, 542 to define 
a channel 554 for first video camera 168. 

Second video camera 170 is operable and adjustable 
in slot 546. A front camera mount assembly 556 having 
a base 558 and a yoke 560 is mounted on bottom plate 
404 parallel to and in approximate longitudinal align- 
ment with second filter 166. Camera mount assembly 
556 defines a generally spherical or oval shaped port 
562 to receive and secure the arcuate and extending lens 
mount 564 of camera 170. A camera mounting bracket 
566 is affixed to a sidewall of first camera 170, such as 
by a plurality of screws engaging the sidewall and cam- 
era 170. Bracket 566 includes a sidewall 568 and an 
upright extending member 570 perpendicular to side- 
wall 568, which upright member has an upper arcuate 
portion 572 and lower arcuate portion 574 extending 
therefrom. These upper and lower arcuate portions 572, 
574 are mountable or positionable in a rear mounting 
camera support 576 with a portal 578 for securing 
therein. Rear mounting support 576 has a threaded 
locking passage 580 for a threaded locking means or 
screw 582, which locking means or screw 582 contacts 
one of the upper and lower arcuate portions 572, 574 to 
secure the location or position of the sidewall 568 and 
camera 170. Rear support 576 also has two through 
passages 584 and 586, which are rnatable or alignable 
with threaded bores 588 and 590 of uprights 538 and 
540, respectively, each open to receive one of a pair of 
securing means, such as bolts 592, to secure camera 
mounting support 576 and thus camera 170 in slot 546 
and chamber 410. In this position, camera 170 is both 
slightly rotatable and longitudinally movable in slot 546 
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to focus the camera output or digitizing means for re- 
view on screen 37. 

First video camera 168 is mounted in and longitudi- 
nally movable in channel 554. Camera 168 is slidable 
along axis 109 in channel 554 to focus the image pro- 5 
jected on screen 37, and it may be secured in channel 
554 by a pressure plate 594 interposed between the 
camera and fifth and sixth upright brackets 548 and 550 
to secure camera 168 against middle or central brackets 
540 and 542 respectively. Pressure plate 594 is secured 10 
against the camera 168 by a pair of threaded locking 
means or bolts 600 extending through passages 596, 598 
in fifth and sixth upright brackets 548, 554, respectively. 
In addition, camera 168 may adjust its signal level with 
a pedestal adjustment means 602 and an electronic gain 15 
adjustment means 604. 

After assembly of the above-noted elements of acqui- 
sition apparatus 18 on bottom panel 404, first and sec- 
ond cameras 168, 170 are positioned in housing 402 and 
a magnified image is transmitted to the cameras in their 20 
assembled positions by adjustment of mirrors 160, 162 
and 158 as well as by adjustment of second beam splitter 
156 and the optical Filters 164,166. First and second 
reflecting mirrors 160, 162 are rotatably adjustable on 
pintles 436 and 438 in sockets 422 and 424, respectively, 25 
to communicate the first light beam 153 from first beam 
splitter 25 to second beam splitter 156. Second beam 
splitter 1S6 is adjustable in recess 440 in a horizontal 
plane generally defined by bottom plate 404. G unbailed 
plate 450 may be adjusted by pivotal motion about pivot 30 
means 462 against the force of lateral bias means 486. It 
is recognized that the several securing means utilized to 
secure the gimbal plate in its desired position are not 
engaged during the adjustment. The vertical adjustment 
of second beam splitter 156 is provided by loosening or 35 
tightening the securing means 480, 482 and 484 to allow 
the beam splitter 156 to slightly rock or rotate on spheri- 
cal bearing 464 against the bias force of vertical biasing 
means 466, 468 and 470. Finally, third reflecting mirror 
158 is adjustable by adjustment means 501 and 503, 40 
which provide vertical and horizontal adjustment to 
generally center the light beam 157 on lens plane 173 of 
first camera 168. It is further recognized that mounting 
base 494 may be slightly adjustable initially as the third 
mirror gimbal assembly is affixed to bottom plate 404. 45 
In FIG. 23. the monochromatic optical filters 164 and 
166 are placed as closely in proximity to second beam 
splitter 156 in order to minimize the intensity losses of 
the light beam signals projected thereto from beam 
splitter 156. In addition, light beam paths 157, 159 from 50 
second beam splitter 156 to first camera 168 and second 
camera 170, respectively, are approximately equivalent 
distances, to provide equivalent light intensities to both 
cameras, which assists in the focusing of the cameras. 

Equipment Focusing 55 

The adjustment or focusing procedure for cameras 
168, 170 is similar to the procedure for the cameras of 
earlier models of analysis equipment. A calibration 
image is provided from microscope 15 through first 60 
beam splitter 25 and focusing lens 154 for reflection by 
first mirror 160 and second minor 162 to second beam 
splitter 156. The split beam or beams 157, 159 from 
splitter 156 are communicated to first video camera 168 
and second video camera 170 through first and second 65 
optical filters 164, 166, respectively. The first and sec- 
ond image outputs from video cameras 168 and 170 to 
the digitizing means is projected on screen 37 for re- 
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view and calibration. Thus, the image in first camera 
168 can be individually focused by slidable camera 
movement along axis 169. Second camera 170 and the 
image projected therefrom to screen 37 may be focused 
and adjusted by rotation about or slidable motion along 
axis 171, which camera 170 is thereafter secured in 
position. After the camera adjustments, the clamping 
and support means secure cameras 168,170. Exemplary 
of adjustment means are front support 556 and rear or 
back support 576 wherein securing means 582 may be 
loosened to allow camera 170 to be rotated about its axis 
171. 

Apparatus 11 is generally utilized for analyzing bio- 
logical cell specimens. The image from objective lens 16 
of microscope 15, which is the projected and magnified 
image of the calibration or cell slide, is projected up- 
ward to beam splitter 25 to provide the image to both 
the ocular lens 24 and focal lens 154, which may have a 
fixed or variable focal length. Magnified image light 
beam 153 after focusing through lens 154, which is a 
real and focused image in contrast to an unfocused and 
virtual image, is reflected by first and second mirrors 
160, 162 to the second beam splitting means 156. First 
beam 153 is divided or split by the second beam splitter 
156 into a second light beam 157 and a third light beam 
159 with about equal intensity for projection and com- 
munication to and through first monochromatic optical 
filter 164 and second monochromatic optical filter 166. 

The apparatus disclosed is particularly useful in the 
analysis of biological cell structures, although it is not 
limited thereto. In this biological cell application, cells 
may be viewed through a compound light microscope; 
however, only distinct outlines and minimal numbers of 
cells or cell constituents would be noticeable. The visi- 
ble cell constituents would only be those that do not 
require a much greater level of magnification. There- 
fore, it has been found that the cell structures may be 
enhanced for optical observation by a chemical tech- 
nique frequently referred to as staining. The stain reacts, 
combines or adheres to a specific cell component, 
thereby outlining or highlighting the component for 
review and analysis. A Feulgen stain technique was 
noted and described above. In addition, alternative 
stains and types of stains were also listed and briefly 
discussed above. 

It is known that cells may be single cell structures but 
most have at least two components, such as a nuclear 
DNA with a DNA nucleus and a protein at a protein 
site associated therewith. Analysis and review of these 
cells and their various components thus requires selec- 
tive staining techniques for analysis, for example pathol- 
ogy studies. In some instances, the staining techniques, 
as noted earlier in the application, provide staining or 
distinguishing characterization of certain components 
of the cells, that is, a first cellular component such as a 
DNA nucleus and a second cellular component such as 
a protein at a protein site. These are merely exemplary 
of components of the cells that are available for staining 
and identification. Among the known proteins are re- 
ceptors, enzymes, structural proteins, glycoproteins, 
and lypoproteins. Other potential cell components in- 
clude nucleic acids (e.g., RNA, mRNA, rRNA, and 
DNA), hormones (e.g., steroids, estrogen, peptide hor- 
mone, and progesterone), and lipids, which are noted as 
components of the cell membranes. It is appreciated 
that these are merely representative of cellular compo- 
nents which may be available for staining and identifica- 
tion by an existing or later discovered staining tech- 



03/30/2004, EAST 



Version: 1.4.1 



23 



5,134,662 



24 



nique. However, in order to observe and identify these 
various components, and thereafter utilize the gathered 
information, it is necessary to first present them in an 
identifiable fashion. Therefore, specific staining tech- 
niques are utilized to provide enhanced optical con* 
trasts for combinations of the various components, each 
component being responsive to a particular stain or 
staining technique. The following listing provides ex- 
amples of stain combinations, which are operable to 
provide contrasting overlapped curves, as in FIG. 8, 
with graphical plots of transmittance as a function of 
wavelength where the maximum for at least one plot is 
adequately separated from the second curve for analy- 
sis. 
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The above-noted stains and staining techniques pro- 
vide enhanced contrast between the various compo- 
nents to be identified and, in addition, have optical char- 
acteristics which may be matched or corrected with 
monochromatic optical filters to provide a discernible 
and identifiable cell component. In a preferred embodi- 
ment, the selected stains react with two separate cellu- 
lar components to provide a contrasting image at two 
distinct limited ranges of wavelength or spectral band- 
widths. This provides the image acquisition apparatus 
with the opportunity to segregate each preferred wave- 
length and to provide the beam splitter and monochro- *® 
mal optical filters the least interference or most narrow 
bandwidth image signals for resolution of the signals to 
the selected or desired wavelengths for analysis by one 
of the video cameras or sensors. 

Cells, which have been stained to highlight or charac* * 5 
terize an individual cell component, are not as formida- 
ble an analytical task as an unstained cell, as the stained 
component will generally be visibly apparent through a 
microscope. The optical equipment or optics related to 
such analysis or recognition are well known. It is recog- 
nized that a stained cell exhibits specific optical charac- 
teristics, such as transmittance, and more particularly it 
may have a maximum transmittance at a first wave- 
length (implying relative transparency) and a minimal 
transmittance at a second distinct wavelength. In the 35 
case where, only a single stain is utilized, either of the 
stained' cell components could be analyzed at any wave- 
length along their curve with some reasonable effort. 
However, when two stains are simultaneously utilized 
on a cell to stain or combine with particular cell compo- 60 
nents, their overlapping spectral emissions may inter- 
fere with each other. As a consequence, extensive filter- 
ing, both optical and electronic, may be required to 
discern the specific parameter, characteristic or cell 
component under investigation. Therefore, it is desir- 
able to provide stains which exhibit contradictory or 
converse transmission characteristics at approximately 
the same wavelengths, which in an ideal condition 
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would imply minimum transmittance of a first stain at 
the maximum transmittance of the second stain, as im- 
plied in FIG. 8 at about 500 nanometers. Communica- 
tion of a narrow band visible light beam through a 
monochromatic optical filter generally provides a light 
beam at about a fixed wavelength, which can be se- 
lected to correspond to the maximum-minimum point 
noted above. The image contrast from these two com- 
peting stains would provide a more easily analyzed cell 
component whose stain characteristic is at its minimum 
transmittance. Similarly, communicating the light beam 
through a second optical filter (about 650 nanometers in 
the Example of FIG. 9) would provide a different 
spread between the spectral transmittance curves. 

In the analysis of cells there are different imaging 
methods, that is different reasons for cell analysis in- 
cluding quantitative immunoploidy (QIP) studies, quan- 
titative nuclear antigen (QNA) analysis and prolifera- 
tion index. As an example, in an immunoploidy analysis, 
a type two stain (Feulgen DNA stain) is applied to the 
nucleus (cf. FIG. 8), and a type one stain of the red- 
chromagen-alkaline phosphatase variety is applied to 
outline and distinguish the cytoplasm. At 620 nm in 
FIG. 8, after acquiring and recombining the separate 
images, the nucleus of the cytoplasm has approximately 
100% transmission and essentially a mask is provided 
and the nuclear DNA is enhanced for review. In some 
cases the review is conducted by optical density mea- 
surements, which were discussed above, for analysis of 
the DNA mass. Alternatively, the separation of the 
curves at approximately 500 nm allows a study of the 
cytoplasm protein sites, which are distinguished by the 
greater absorbency of the illustrated red chromagen 
stain. 

In the quantitative nuclear antigen measurements, the 
cell component interest may be restricted to the nucleus 
and more specifically nucleus components. The compo- 
nents may be nonspecific nuclear proteins and specific 
proteins. As illustrated in FIG. 29, the nonspecific pro- 
teins or all nuclei are stained with a type one (acid-base 
reaction) stain, such as ethyl green, and the specific 
proteins or antigens are stained with a type three stain, 
such as diaminobenzidene (DAB). The immunohisto- 
chemical stain (type three) has an antibody stain that is 
specific to an antigen of some of the nuclei, such as an 
estrogen receptor, progesterone receptor or a prolifer- 
ating cell antigen. After application of the peroxidase 
which colors the antigen, light transmitted through the 
stained cell will be absorbed or transmitted at different 
rates as noted in FIG. 29 at the 500 nm and 620 nm 
ranges. As noted in this Figure, at 500 nm the ethyl 
green stained nucleus has essentially 100% transmit- 
tance, and the DAB stained nuclear component absorbs 
a large percentage of the light. Therefore, the DAB 
stained component (red channel) shows through. This 
method provides a mask for the nuclei and the dark 
objects are distinguishable. At the second or blue chan- 
nel, the actual intensity or stain density of the nuclear 
components is measured, that is, the area of the mask 
that is immunohistochemically stained. The red channel 
is thus distinguished, as there is no output from the 
masked component with 100% transmittance. Earlier 
analytical color camera developments did not utilize 
two different stains. 

In FIG. 30 a specific case of stained components is 
demonstrated wherein each of the stained components 
demonstrates substantially 100% transmittance at the 
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exemplary 500 nm and 620 nm wavelengths, which their efficiency by limiting the background "noise" to 

provides two locations for analysis and thus quantita- be screened from the desired light signal. 

tive analysis of each component. Second beam splitter 156 may be exemplary of a 

The above-noted examples clearly indicate and exem- dichroic beam splitter, and, for example, may provide 

plify methods of cell analysis and more specifically, 5 transmission of all wavelengths of light above 550 nano- 

quantitative analysis of cell components with true opti- meters and reflect all wavelengths below 550 nanome- 

cal and mass determination. The first monochromatic ters. Therefore, marking a cell, such as those selected 

image above provides a means to provide the quantita- from a patient for cancer analysis, by utilizing one of the 

tive analysis of at least the first component, and the above-noted stain combinations will cause the first stain 

second monochromatic image is invaluable in the identi- 10 to mark the nucleus and the second stain to mark the 

fication of other cell components. associated protein at a protein site. Individual light 

The present invention provides both method and beams at different specific wavelengths for the stained 
apparatus to correlate various stain pairs with the re- cell are consequently provided to the first and second 
quired monochromal optical filters. The two-color camera. Thus, each of the individual components after 
camera system is principally used in immunohistochem- 15 appropriate optical filtering are analyzed at one of the' 
istry stain applications. These are very often two-color first and second channels, which is dependent on the 
stains, that is the colored antigen/antibody/stain com- light at a wavelength either transmitted or reflected 
plex vs. cells in tissue compartments without antigen thereto. The electronic light signal from the camera is 
and stained with a countersign. As it is frequently de- transmitted to the computer analysis system for conver- 
sired to quantitate either the material counterstained or sion to a digital signal, storage and analysis of each of 
the antigen/antibody complex, via measurement of cell the first and second channel signals and/or combination 
stain content, it is helpful if at least one of the staining of these two individual signals or figures for compara- 
components does not have a spectral overlap at the tive analysis in an overlapping array, 
sensing wavelength of one of the image sensors. It is The two-color camera analytical system of the pres- 
preferred to make measurements at approximately the ent invention is matched to the staining spectra of 
peak transmission value, preferably 100% transmission, readily available, common acid-base and immunohisto- 
as that provides the biggest contrast to the surrounding chemical stains. The spectral wavelengths chosen 
light spectra and cell components in the cell matrix. match at least one region of 100% transmission of one 
Further, the visible light spectrum is not a very broad 3Q paired stain component. At the same time, the narrow 
band region of the total light spectrum, and analysis of bandpass filters reduce glare. This is important for pur- 
cells using a second stain may introduce interference of poses of accurate densitometry measurements of the 
the overlapping spectra, as these stains tend to be broad stained substance. By comparison the sensing spectra of 
band spectra or have broad band spectral outputs. In typical solid state ordinary "color" cameras use three 
addition, wide bandpass spectral filters of standard 35 broad band spectra (these are chosen to match the color 
color cameras or sensors contribute to any glare prob- visual receptors of the human eye). These overlap with 
lem during the analysis. Thus, the narrow bandpass the broad-band, two component, cell staining spectra, 
filtering reduces an inherent problem of earlier struc- e.g., FIGS. 8, 29, and 30; and the wide bandpass spectral 
tures. In addition, use of a standard color camera for filters of the standard color cameras contribute to glare, 
review of multi-stained cells invites an inherent problem 40 In addition, the color filtering of standard color cameras 
in the output and review of the cells, that is, pixel-to- occurs on separate pixels (different lines of video) on 
pixel alignment of the separate images cannot be accom- the solid state sensing chips. Thus, the pixels are not 
modated as the same regions are not projected in each from the same regions in the three-colored images of a 
pixel in the three (usually red, green, blue) colored color camera. 

images provided from a color camera. As a conse- 45 It is apparent, as noted above, that the mere enhance- 
quence, the images under review are not accurately or ment of a cell or cell component by staining has been 
consistently reviewed during the analysis, whereas the known for quite some time; and further, that the various 
inventive structure provides for pixel-by-pixel calibra- components of individual cells react or respond to dif- 
tion, alignment and cell review. ferent stains and staining techniques. Past efforts at cell 
The image acquisition apparatus noted above pro- 50 analysis have generally been limited to single camera 
vides a means to split or divide the amount of light apparatus or complex analysis of broad band spectra 
communicated to each of the individual cameras across the total visible light spectrum. The present in- 
through the use of a beam splitter, which is preferably a vention provides a relative "balancing" of the available 
dichroic beam splitter. This attenuation of the light or stains, the spectra of the light transmitted, the optical 
light transmission may be accomplished at a specific 35 filters and beam splitters, which all cooperate to pro- 
wavelength, as the beam splitter is transparent to a band vide attenuated or more easily analyzed signals. Thus, a 
of wavelengths either above or below the selected complete system is provided which matches the rea- 
wavelength thus allowing that band of light to be trans- gent, the camera, the special software analysis proce- 
mined through the splitter; and, it reflects the light dure, as well as the hardware related to the computer- 
beam at the other wavelengths above or below the 60 ized network. The monochromal optical filters 164, 166 
preselected wavelength and thus limits the band width and second beam splitter 156 are removable for replace- 
of the light transmitted to each of the monochromal ment with alternative filters and beam splitters to more 
optical filters. Whether the light beam communicates to readily match the wavelengths for analysis of specific 
the beam splitter is merely split or split at a specific cell components, which are marked by appropriate 
wavelength, the optical filters selectively limit the light 65 staining and spectra. Therefore, it can be seen that the 
transmitted to the cameras to a specific or narrow range above-noted, two-color stain system and dual color 
of wavelengths for analysis. Provision of a narrow sensor system, which is a narrow band-pass filter sys- 
band width light beam to the optical filters improves tern, used to provide a light signal, which is measured 
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for optical density and correlated to known conditions 
for both quantitative as well as qualitative analysis. 

All of the chromogens that are presently known for 
use in staining are wide band pass chromogens and do 
not provide the narrow band pass that would make 
analysis, if not easier, at least more readily accessible, 
thus requiring the steps utilized to screen or filter the 
overlapping light signals. The stain agents are distinct 
markers selected to be nonreactive with each other 
when two or more stains are utilized for simultaneously 
staining the same cell. One of the problems associated 
with the use of cameras and electronic equipment is the 
required effort to maximize the signal intensity at the 
measured wavelength to overcome or minimize the 
electrical noise. If the electronic gain is increased for 
the individual electronic apparatus, the sensors or cam- 
eras in this case, the noise ratio or level would also 
increase. The present apparatus was, therefore, pro- 
vided without utilizing video cameras with a "white 
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or secured in place. The optical equipment should not 
be contacted by fingers during the adjustment period. 
Similarly, second mirror 162 is rotated to provide an 
undipped image to the mask, and first beam splitter 25 
is adjusted to properly center the third beam. Subse- 
quently, second mirror 162 is likewise secured by lock- 
ing screws. 

The target can now be removed, and the grid image 
will be projected on face plate 175 for centering. The 
elevation or vertical alignment of the projected image 
on face plate 175 of second camera 170 may be centered 
by rotation or adjustment of locking screws 480, 482 
and 484 of second beam splitter 156. Adjustment of the 
grid image on face plate 175 across its horizontal plane, 
that is, left to right, is accommodated by rotation of 
second beam splitter 156. Adjusting screw 192 securing 
locking washer 488 is loosened, and turning adjustment 
screw 493, which contacts the beam splitter mounting 
pedestal 450, moves pedestal 450 in recess 440. After 



power or intensity of the output signal. Consequently, 
all of the light intensity and response is provided 
through the optical system to the cameras of the present 
invention. 
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clip", which is known to minimize the level of the 20 proper alignment, securing screw 492 may again be 

tightened to secure washer 488. The grid image, which 
is generally red, on face plate 173 of first camera 168 
may be adjusted by adjustment of screws 501 and 503 on 
the reverse side of third mirror 158. Bottom screw 503 
will move the image left and right across the face plate 
173, whereas top screw 501 will adjust the image verti- 
cally up or down and will also rotate the image slightly. 
Thus, screws 501, 503 are utilized to center the image 
on face plate 173. It is noted that rotation of the image 
will require repetition of the earlier adjustment of the 
first beam splitter 25 and also correct centering of the 
grid image on face plate 175 of second camera 170. 

If finer adjustment of the coupler is required, an ad- 
justment cover is placed on the apparatus 18, and, if 
removed, the eyepiece is returned to the coupler. The 
grid slide is focused and centered in the eyepiece. Ac- 
cess to front and back rotation lock screws 604 and 582 
of second camera 170 is provided through the alignment 
cover. These screws are loosened and the image from 
second camera 170 is displayed on monitor 37. Thereaf- 
ter, second camera 170 is slidably moved along its axis 
171 until the monitor image is properly focused. Subse- 
quently, locking screws 600 for first camera 168 are 
loosened, and the image from first camera 168 is dis- 
played on monitor 37. First camera 168 is similarly 
slidably moved along its longitudinal axis 169 to focus 
the image on monitor 37. Locking screws 600 are there- 
after tightened, and cameras 168, 170 are now in par- 
focus. The image on monitor 37 from first camera 168 is 



Initial Equipment Calibration 

Calibration, adjustment, alignment and/or focus of 
the present two-camera apparatus is required prior to its 
use as an analytical tool. In the alignment procedure, a 
calibration or reference slide with a grid pattern is 30 
mounted on the microscope stage. The grid pattern may 
take the form of crosshatched lines separated by ap- 
proximately 0.01 mm, which define a matrix or pattern 
of small squares. Thereafter, the reticule cross-hair of 
the microscope, usually visible through the ocular lens, 35 
is centered or aligned with the heavy centerlines of the 
grid pattern, which generally provides centering of the 
object in the microscope. The microscope is focused by 
adjustment of the microscope diaphragm with the mi- 
croscope in focus, centered, and just at the edge of the 40 
field-of-view. 

After the above-noted initial steps, the microscope 
eyepiece [not shown] is removed from the apparatus 18. 
Mirrors 160 and 162 on their pedestal mounts 436, 438, 
respectively, are rotated in pockets 422, 424. Mirror 160 45 
is rotated to reflect the optical beam back through the 
focusing lens 154 to the top of the objective diaphragm 
[not shown]. Rotation of mirror 160 will move the re- 
flected beam up and down across the objective dia- _ 

phragm. Adjustment of screws 120 in threaded bores 50 centered by adjustment of screws 501 and 503 on third 



418 of the mounting securing beam splitter 25 will ad 
just the position of the beam to transmit it through the 
center of the objective lens. A blocking target or mask 
is interposed between the transmitted or reflected sec- 
ond and third light beams 157 and 159 in front of cam- 
eras 168, 170, which beams 157, 159 impinge on this 
target. First mirror 160 is rotated to reflect the beam to 
second mirror 162, which second mirror 162 is likewise 
rotated to reflect the beam to third mirror 158 through 
second beam splitter 156. Mirrors 160 and 162 are there- 
after secured in position by the locking screws 430. 

Beams 157 and 159 should be noticeable on the noted 
target or mask. First mirror 160 should be rotated such 
that the beam to camera 170 is a full circle and not 
"clipped," on either the left or right side. If the beam is 65 
clipped on the top or bottom, first beam splitter 25 must 
be adjusted by rotating screws 420 until the beam is 
centered. Thereafter, first mirror 160 should be locked 
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mirror 158. In this adjustment, there should be an equal 
number of lines on either side [and top to bottom] of the 
center heavy lines of the grid pattern. The image from 
second camera 170 is again displayed on monitor 37 and 
this image is centered by rotation of adjusting screws 
480, 482 and 484 of second beam splitter 156 for left-to- 
right adjustment Vertical adjustment of the image from 
camera 170 is again provided by loosening screw 492 
and rotating adjusting screw 493 to adjust pedestal 450 
in recess 440 prior to resecuring screw 492. The pro- 
jected grid image is again checked for proper alignment 
in both vertical and horizontal directions. The images 
from both first camera 168 and second camera 170 are 
now projected on monitor 37, and the images are 
aligned such that there is no greater than i line width of 
grid pattern between the superimposed images. Vertical 
and horizontal adjustments are provided by adjusting 
screws 501 and 503 of third mirror 158, whereas rota- 
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tional adjustments are made by physically rotating sec- 
ond camera 170. Second camera 170 is rotated until the 
grid lines of both images are parallel, however, care 
must be utilized to avoid changing the focus of second 
camera 170. Both front and back rotation lock screws 5 
604, 582, respectively, are thereafter secured to main- 
tain second camera 170 from further rotation. Third 
mirror 158 is now adjusted to provide vertical and hori- 
zontal alignment of the grid on the monitor. The rota- 
tional and vertical-horizontal adjustment may require 10 
repetition to achieve proper alignment. The grid slide 
on the microscope is now moved to a clear area, and the 
microscope diaphragm is adjusted for proper focus, size 
and centering. A proper light intensity is provided by 
attaining a reading of approximately 200, which is a 15 
comparative gray-scale reading on the second camera 
170, and the gain adjustment 604 of first camera 168 is 
adjusted to similarly give a light reading of 200. The 
apparatus cover 402 is reinstalled and the apparatus is 
prepared and ready for operation. 20 

It is further considered that the above apparatus is 
equally applicable to a fluorescent antibody stained cell. 
As an example, when infectious agents such as viruses 
and bacteria, and other antigenic materials which are ^ 
principally of a protein nature, invade body tissue, solu- 
ble substances are produced which specifically react 
with these alien materials. The soluble substances are 
called "antibodies" and materials which elicit their pro- 
duction are called "antigens." Antibodies can be cou- 3Q 
pled to fluorescent dyes such as Fluorescin. Antibodies 
labeled by fluorescent dyes are called "fluorescent anti- 
bodies*' and are utilized as immunospecific stains for the 
detection of antigens in cells and tissues. The marked 
regions in a cell are seen as a characteristic color when 35 
the cell section is examined with a fluorescent micro- 
scope. This method of fluorescent microscopy may also 
be operable with the above-noted apparatus. Transmis- 
sion microscopy was utilized for the examples in the 
particular description noted above. However, it is ap- 
preciated that the present apparatus may be applicable 
to the fluorescent microscopic analysis at specific wave- 
lengths. A proper staining agent must be utilized to 
mark either the nucleus and/or protein at a selected 
protein site when either the fluorescent or transmission 45 
microscopy techniques are utilized with the apparatus 
and system of the present invention. 

While only specific embodiments of the invention 
have been described and shown, it is apparent that vari- 
ous alterations and modifications can be made therein. It so 
is, therefore, the intention in the appended claims to 
cover all such modifications and alterations as may fall 
within the scope and spirit of the invention. 

What is claimed is: 

1. A method of analyzing cells, having at least a first 52 
cellular component and a second cellular component, 
said method comprising: 

chemically-optically enhancing the cells with at least 
a first and a second spectral stain material; 

each of said spectral stain materials including the first 60 
and second spectral stain materials combining with 
one of said cellular components to form at least a 
first cell combination and a second cell combina- 
tion, 

said first cell combination having an optical transmit- 65 
tance at a first predetermined wavelength and a 
lower optica] transmittance at a predetermined 
second wavelength, 



said second cell combination having a substantial 
light absorption at said first predetermined wave- 
length; 

transmitting an image of at least the first and second 
cell combinations; 

splitting and filtering said image into multiple images 
including at least a first filtered image in a first 
spectral wavelength bandwidth and a second fil- 
tered image at a second spectral bandwidth wave- 
length; 

sensing the filtered images including the step of sens- 
ing the first filtered image with a first sensing 
means to provide a first electrical output represen- 
tative of the first filtered image and of sensing the 
second filtered image with a second sensing means 
to provide a second electrical output representative 
of the second filtered image; and 

providing an analysis of characteristics of the cells at 
a characteristic analyzer based on the electrical 
outputs including those from the first and second 
sensing operations. 

2. A method in accordance with claim 1 wherein the 
step of chemically-optically enhancing the cells with 
first and second materials comprises treating said cells 
with a monoclonal antibody stain. 

3. A method in accordance with claim 1 further com- 
prising the steps of processing the electrical signals from 
each sensing means separately to provide cell analysis 
information and also combining the information from 
both sensing means to provide a quantitative analysis of 
the examined cells. 

4. A method of analyzing cells as claimed in claim 3 
and further comprising: 

providing a means for displaying any of said first 
image said second image and said combined image; 
and 

coupling said display means to said means for analyz- 
ing to receive said sensed images. 

5. An apparatus for the analysis of cells with at least 
a first cellular component and a second cellular compo- 
nent and with at least a first spectral material and a 
second spectral material, one of said first and second 
cellular components chemically combining with one of 
the first and second spectral materials to provide a first 
cell combination and the other of said first and second 
cellular components chemically combining with the 
other of said first and second spectral materials to pro- 
vide a second cell combination, 

said apparatus comprising: 

a source for projecting light on said cell; 

means for forming and magnifying an image of the 
first and second cell combinations and for commu- 
nicating the image; 

means for splitting and filtering the communicated 
image into a plurality of images including a first 
filtered image in a first spectral wavelength band- 
width and a second filtered image in a second spec- 
tral wavelength bandwidth, 

sensing means for sensing the plurality of images 
including a first means for sensing the first filtered 
image and providing a first electrical output repre- 
sentative thereof and including a second means for 
sensing the second filtered image and providing a 
second electrical output representative thereof; and 

means for analyzing said cell combinations and thus 
said cells, which analysis means is operable to re- 
ceive and store the outputs of the sensing means 
including those from the respective first and sec- 
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ond sensing means electrical outputs, and to com- 
bine at least said first and second images to provide 
an analysis therefrom, and to provide an output 
about at least one cell characteristic. 
6. An apparatus for the analysis of cells as claimed in- 5 



claim 5 wherein said means for analyzing further com- 
prises a means for displaying said first image, said sec- 
ond image, said combined first and second image and 
said analysis thereof. 
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